Papers with token-level techniques
AMR-DA: Data Augmentation by Abstract Meaning Representation (2022.findings-acl)
Copied to clipboard
| Challenge: | Abstract Meaning Representation (AMR) is a semantic representation for NLP/NLU. |
| Approach: | They propose to use AMR-DA for data augmentation in NLP . they use sentence-level techniques like back translation and token-level methods like EDA . |
| Outcome: | The proposed method outperforms EDA and AEDA and improves on STS and text classification tasks. |
NSP-BERT: A Prompt-based Few-Shot Learner through an Original Pre-training Task —— Next Sentence Prediction (2022.coling-1)
Copied to clipboard
| Challenge: | Recent studies have shown that using prompts to utilize language models to perform downstream tasks is more effective than using token-level methods such as PET. |
| Approach: | They propose to use a BERT original pre-training task abandoned by RoBERTa and other models to construct a sentence-level prompt-based method that does not need to fix the length of the prompt or the position to be predicted. |
| Outcome: | The proposed method performs better than PET and EFL on a BERT pre-training task and is comparable to other prompt-based methods. |